Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Post-epidemic health system recovery: A comparative case study analysis of routine immunization programs in the Republics of Haiti and Liberia

  • Sanjana J. Ravi ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Writing – original draft, Writing – review & editing

    sanjana@jhu.edu

    Affiliation The Johns Hopkins Center for Health Security, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States of America

  • Christina M. Potter,

    Roles Data curation, Investigation, Writing – review & editing

    Affiliation The Johns Hopkins Center for Health Security, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States of America

  • Ligia Paina,

    Roles Writing – review & editing

    Affiliation Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States of America

  • Maria W. Merritt

    Roles Supervision, Writing – review & editing

    Affiliations Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States of America, Johns Hopkins Berman Institute of Bioethics, Baltimore, Maryland, United States of America

Abstract

Large-scale epidemics in resource-constrained settings disrupt delivery of core health services, such as routine immunization. Rebuilding and strengthening routine immunization programs following epidemics is an essential step toward improving vaccine equity and averting future outbreaks. We performed a comparative case study analysis of routine immunization program recovery in Liberia and Haiti following the 2014–16 West Africa Ebola epidemic and 2010s cholera epidemic, respectively. First, we triangulated data between the peer-reviewed and grey literature; in-depth key informant interviews with subject matter experts; and quantitative metrics of population health and health system functioning. We used these data to construct thick descriptive narratives for each case. Finally, we performed a cross-case comparison by applying a thematic matrix based on the Essential Public Health Services framework to each case narrative. In Liberia, post-Ebola routine immunization coverage surpassed pre-epidemic levels, a feat attributable to investments in surveillance, comprehensive risk communication, robust political support for and leadership around immunization, and strong public-sector recovery planning. Recovery efforts in Haiti were fragmented across a broad range of non-governmental agencies. Limitations in funding, workforce development, and community engagement further impeded vaccine uptake. Consequently, Haiti reported significant disparities in subnational immunization coverage following the epidemic. This study suggests that embedding in-country expertise within outbreak response structures, respecting governmental autonomy, aligning post-epidemic recovery plans and policies, and integrating outbreak response assets into robust systems of primary care contribute to higher, more equitable levels of routine immunization coverage in resource-constrained settings recovering from epidemics.

Introduction

Acute infectious disease outbreaks are major causes of morbidity and mortality worldwide. Such crises place enormous strains on health systems to both scale up core public health activities to mitigate the threat at hand and absorb escalating demand for emergency medical services. Concurrently, outbreaks also derail routine health service delivery by diverting needed human, financial, and medical resources away from essential health programs. Such strains are especially consequential in resource-constrained settings with large existing burdens of endemic disease, where barriers to accessing basic health services are consistently high, and where even routine care-seeking could result in catastrophic health spending for individual patients and families.

Though the disruptive impacts of major outbreaks on health system performance are well-characterized, the mechanics of post-epidemic health system recovery remain somewhat obscure, especially in low- and middle-income countries (LMICs) [13]. Emergency planning efforts often prioritize acute response activities (e.g., managing patient surges, reducing disease incidence and mortality) over longer-term health system considerations and population health needs, such as resuming delivery of routine immunization, nutrition, mental health, and reproductive health services [4]. A recent analysis of 154 COVID-19 response plans from 106 countries, for instance, reveals that only 47% included provisions for maintaining essential health services, while only 7% addressed monitoring and evaluation of such services [5]. Recouping losses of health service coverage, rebuilding trust among target populations, and rectifying distortions of national health priorities due to external donor influence are further examples of post-epidemic health system recovery challenges [6]. Underpinning many of these challenges is an imperative for decision-makers to integrate vertically channeled resources for outbreak response into resilient systems for providing routine care.

Routine immunization considerations are particularly important during post-epidemic recovery. Immunization is among the most effective public health interventions, and high levels of coverage are both key to averting outbreaks of vaccine-preventable diseases and an important proxy of strong health system functioning [7,8]. Two recent crises, the 2014–16 West Africa Ebola epidemic in Liberia and the 2010s cholera epidemic in Haiti, serve as instructive–and contrasting–cases of routine immunization program recovery after destabilizing outbreaks. Though national coverage of the first dose of measles-containing vaccine (MCV1) plummeted to 58% in Liberia in 2014 (the first year of its Ebola epidemic), this estimate surged to 87% in 2017, the year after the epidemic was declared over. Similarly, the percentage of Liberian districts reporting over 80% MCV1 coverage increased from 7% in 2014 to 80% in 2018. By contrast, unfortunately, national MCV1 coverage in Haiti stagnated between 64–69% during its years-long cholera epidemic (2010–2019), while the proportion of districts with MCV1 coverage above 80% fell to as low as 21.43% during this period [9].

This study examines the factors that contributed to these differing trajectories, particularly those related to public health practice during and after each country’s epidemic. By comparing the post-epidemic measures implemented in each setting, we identify facilitators and barriers of efforts to rebuild and strengthen routine immunization programs.

Methods

We performed a case study analysis to explore efforts to integrate outbreak response assets into routine immunization programs in LMICs and improve post-epidemic routine immunization coverage. We utilized a comparative “most-similar” design, wherein we examined two distinct cases that are similar across relevant background conditions but differ across select independent variables and the outcome of interest [10].

Case selection

The two cases chosen were the 2014–16 West Africa Ebola epidemic in Liberia and the 2010s cholera epidemic in Haiti. These cases were selected by reviewing WHO’s Disease Outbreak News archive of notifiable events reported by country and year (reviewed in October 2019) [11]. To ensure availability of relevant, recently published literature and data, we sought high-profile, rapid onset, naturally occurring infectious disease epidemics that took place in LMICs before 2010, resulted in considerable morbidity and mortality, overwhelmed the health system capacities of affected countries, demonstrated potential for transnational spread, and required significant international intervention and coordination to mitigate.

We determined that the 2014–16 Ebola epidemic in Liberia and the 2010s cholera epidemic in Haiti were the most comparable cases. Both are small, low-income countries with similar governance structures: they are representative, democratic, presidential republics with bicameral legislatures [12,13]. Their national health systems share a similar structure, being comprised of primary-level clinics, service delivery points, and community-based health centers offering basic preventive and curative services; secondary-level hospitals providing emergency, diagnostic, and surgical services; and tertiary-level facilities providing specialized surgical services and advanced care for non-communicable conditions [14,15]. Both countries rely heavily on foreign aid and external donors to subsidize basic health service provision [16,17]. Finally, the Ebola and cholera epidemics were both preceded by major destabilizing events that drastically weakened health system capacities: in Haiti, a catastrophic earthquake, and in Liberia, the First and Second Liberian Civil Wars. Yet, as previously noted, the World Health Organization (WHO) and UNICEF report contrasting trends in post-epidemic routine immunization coverage between the two countries–a feature of these cases enabling theoretical replication [18].

Our chosen unit of analysis in each case was the post-epidemic process of immunization program recovery at the national level, whereby resources channeled vertically toward outbreak response efforts were leveraged with varying degrees of success to increase routine immunization coverage.

Data collection

Data were gathered from and triangulated among three sources to ensure credibility: 1) peer-reviewed and grey English-language literature; 2) publicly available quantitative databases; and 3) key informant interviews with subject matter experts (see Discussion for further consideration of methodological strengths and limitations).

First, we performed a rapid review of the peer-reviewed, English-language literature in PubMed and Scopus, identifying scholarly analyses of routine immunization challenges in Liberia and Haiti both during and after the Ebola and cholera epidemics, respectively. Rapid reviews–also known as rapid evidence assessments–involve a critical appraisal of what is already known about the topic of interest, with the goal of informing decision-making in a timely, efficient manner [19,20]. Such assessments typically seek to examine the impact of a given variable or intervention, or the antecedents of a given outcome, which suited the purpose of this case study analysis [21]. The results were narrowed to papers published between the ten years prior to each country’s epidemic and the present day. Additionally, we purposively scanned the grey literature to identify technical reports, whitepapers, and other relevant documents relating to post-epidemic routine immunization funding, programs, and activities in both countries. We also applied forward- and backward-snowballing methods (i.e., electronic citation tracking and parsing the references of initially identified sources, respectively) to identify additional relevant documents. Further details of the search strategy (i.e., search terms and document libraries) are available in S1 Appendix.

Next, we obtained quantitative data describing vaccination coverage, immunization and other health system capacities, health spending, and humanitarian and foreign aid disbursements in both countries. Given limited availability of quantitative data for each country, we focused our search on the five years preceding and following the year in which each country’s epidemic began. A list of specific databases consulted and measures collected is also available in S1 Appendix.

The third arm of data collection involved semi-structured key informant interviews who currently or formerly worked in the health or humanitarian response sectors in either Liberia or Haiti during or after each country’s respective epidemic. We sought key informants with expertise in routine immunization, infectious disease epidemiology, outbreak response, health systems-strengthening, community health and primary care, policy, or governance. Drawing from the literature review, a priori knowledge, and the Essential Public Health Services framework (see “Data Analysis” below), we developed a preliminary interview protocol to help guide discussions with key informants (S2 Appendix). Next, we identified potential interviewees from our rapid review, existing professional networks, and via snowballing (i.e., soliciting recommendations from confirmed interviewees). We sent interview invitations to 82 individuals via email; ultimately, a total of 21 individuals agreed to participate, including 10 informants with expertise on Haiti and 11 experts on Liberia. A descriptive, de-identified roster of confirmed key informants is provided in S3 Appendix.

The interviews took place between June 7-August 5, 2021, ranged between 45 minutes to an hour each, and were conducted in English. Interviews proceeded on a not-for-attribution basis to encourage frank conversation, and participants provided both written consent via email and oral consent prior to recording. One member of the project team led all the interviews, which were held and recorded via video conference or phone. A second team member took detailed notes on each call, and all recordings and notes were archived on a password-protected server accessible only to the project team. We ceased soliciting additional informants once no significant or novel findings emerged from subsequent interviews.

Data analysis

First, we informally surveyed the literature to identify potential analytical frameworks with which to perform cross-case comparisons. The revised Essential Public Health Services framework (“the Framework”) emerged as a possible cross-case comparative tool (see Fig 1) [22]. Fitter et al. have applied this framework to examine post-earthquake and -cholera health system recovery in Haiti, while others have described it as a roadmap for post-disaster community revitalization [2325]. Additionally, the Public Health National Center for Innovations and the de Beaumont Foundation recently led an effort to revise the Framework to more explicitly center health equity considerations [26]. For these reasons, we regarded the revised Framework as a suitable tool for comparing post-epidemic immunization program recovery trajectories in Liberia and Haiti.

thumbnail
Fig 1. The 10 Essential Public Health Services (courtesy of the U.S. Centers for Disease Control & Prevention and the de Beaumont Foundation).

https://doi.org/10.1371/journal.pone.0292793.g001

We coded the literature and interview notes in NVivo 12, using the components of the Framework as our coding scheme. Additionally, during the coding process, we iteratively identified new themes that were not articulated in the original Framework: the roles of colonialism in shaping health systems, country ownership of health programs, and the role of health service integration in post-epidemic recovery. [27]. Upon completion of coding, we used the Framework as a cross-case analytical matrix to order data abstracted from each case and examine similarities and differences between cases across the thematic codes (i.e., “stacking comparable cases”) [28]. By critically reviewing the completed matrix for similarities and differences between the two cases, we identified factors that facilitated or impeded equitable vaccination coverage in post-epidemic Liberia and Haiti. As part of the cross-case analysis, we present relevant mean values for our quantitative measures (i.e., national immunization coverage estimates and health expenditures), in addition to incorporating other quantitative measures throughout each case narrative to illustrate trends in pre- and post-epidemic health system functioning in each country. We also used Stata 17 to perform one-way repeated measures analyses of variance (ANOVA) to assess the potential significance of changes in these measures during the five years preceding and following the year of epidemic onset in each country [29].

Finally, to ensure the transferability of our findings, we constructed thick descriptive narratives for each case, incorporating findings from the literature, interviews, and quantitative databases [30]. Quotes from key informants were verified by reviewing interview recordings. As it did not qualify as human subjects research, this investigation was deemed exempt from full review by the Institutional Review Board at the Johns Hopkins Bloomberg School of Public Health (FWA #00000287).

Reflexivity statement

At the time of writing, the study team consisted of a recent doctoral graduate (SJR), a junior scholar (CMP), a health systems researcher (LP), and a public health ethicist (MWM), all of whom are employed by a large research university in the United States. SJR adopted a pragmatic lens to conceptualize the study and while leading the data collection and analysis activities described above. To foster reflexivity, SJR and CMP met routinely over the course of the investigation to review study notes and data, discuss emergent findings, and reflect on researcher positionality. LP and MWM provided critical feedback on the study design, data analysis, and manuscript development; MWM also supervised the study. None of the authors have worked directly in Haiti or Liberia; however, SJR and CMP have actively engaged with researchers, practitioners, and scholarship from both countries.

Findings

Throughout each country’s case narrative, we refer to key informants by anonymized alphanumeric identifiers (S3 Appendix). Additional quotes from key informants are presented in S4 Appendix, where they have been mapped against the components of the Framework. We also provide narratives of key historical events in Haiti and Liberia in S5 Appendix. These historical summaries are meant to provide relevant contextual details and inform broader understandings of health system functioning, particularly with respect to how colonialism and imperialism have shaped population health and public health practice in each country.

Haiti

A 7.2 magnitude earthquake struck Haiti on January 12, 2010, displacing millions across the country. The official death toll has been disputed, with some estimates placing the number of deaths at 158,000, while the Haitian government reports as many as 316,000 lives lost [31,32]. The earthquake also destroyed an estimated 250,000 homes and 30,000 businesses, sparking protests over the initially sluggish influx of emergency assistance [33].

A Post-Disaster Needs Assessment (PDNA) performed by the United Nations Development Programme highlighted devastating impacts on the country’s already-tenuous health system. Prior to the earthquake, stark inequities were reported in health service access and utilization, reflecting the impact of historical and political chaos on its health system. Maternal and infant mortality rates in 2010 were reported at 630 deaths and 57 deaths per 100,000, respectively; only 6% of the poorest women in Haiti gave birth in a health facility, compared to 65% of the wealthiest; and 47% of the population lacked access to healthcare altogether [34]. In 2013, a few years after the earthquake, only 43% (n = 332) of Haiti’s 786 primary health facilities were deemed to be accessible, while a mere 4% (n = 30) and 6% (n = 42) reported effective service delivery and satisfactory primary care functions, respectively [35]. Furthermore, with a health workforce density of 0.65 doctors, midwives, and nurses per 1,000 people in 2015, Haiti–a country of over 10 million people–falls well below the WHO-recommended minimum health workforce density (4.45 doctors, midwives, and nurses per 1,000) required to achieve the Sustainable Development Goals [36].

Between 2003 and 2009, out-of-pocket costs ranged between 39–48% of the country’s total health expenditures while domestic government health expenditures per capita fluctuated between 6–21%, a consequence of Haiti’s fee-for-service healthcare scheme [37]. In fact, Haiti’s Expanded Programme on Immunization (EPI) estimated that a basic package of health services, including immunization, would cost roughly USD$60 per capita, well above the government’s then-health expenditures of USD$31 per capita [38]. Immunization coverage during this period was also dangerously low: Haiti’s 2005–06 Demographic Health Survey (DHS) reported that a mere 25.7% of children in the wealthiest quintile had received all age appropriate vaccinations, compared to only 9.1% of their poorest counterparts [39]. Figs 24 illustrate trends in immunization coverage and under-5 mortality in Haiti during its pre- and post-earthquake periods, drawing from data published in the country’s WHO-UNICEF Joint Reporting Form on Immunization. KI10 described the wide-ranging challenges in administering vaccines after the earthquake: “Vaccinating children was always a struggle…At the micro level, we were able to vaccinate some children in the district, but at the macro level, there were a number of barriers. There are issues with data quality, data collection, planning, and supervision of activities. [The] Ministry of Health has the burden of vaccinating children but there are not sufficient numbers to cover the territory. They were also not well supervised”.

thumbnail
Fig 2. Proportion of districts with at least 80% MCV1 coverage in Liberia and Haiti, 2008–2019.

https://doi.org/10.1371/journal.pone.0292793.g002

Before 2010, cholera had not been reported in Haiti for over a century [40]. Then, in October of that year, a group of Nepali MINUSTAH peacekeepers arrived in Haiti to support earthquake relief efforts. Epidemiological evidence suggests they had contracted cholera while training in Kathmandu Valley amid an ongoing outbreak, before arriving in Haiti without being screened for the disease [41]. On October 21, Haiti’s National Laboratory of Public Health detected the causative agent, Vibrio cholerae, and by October 27, 4,722 cases and 303 deaths were reported [42]. Haiti’s fragile post-earthquake water and sanitation infrastructure catalyzed rapid community transmission. Ultimately, the epidemic–which was finally declared over in 2019 –resulted in roughly 820,000 cases and claimed nearly 10,000 lives [43].

According to KI4, the response to the cholera epidemic mirrored the initial disjointedness of earthquake relief activities, with donors and agencies frequently sidelining Haiti’s ministry of health (Ministère de la Santé Publique et de la Population, MSPP) in favor of commandeering their own response strategies and implementing highly siloed surveillance, healthcare, and vaccination programs. KI4 also observed that the outbreak had immediate impacts on routine health service coverage, recalling, “There was reduced access to essential health services, so paradoxically, it was better to get cholera than any other disease. It mostly had a negative impact on other essential health services. And the staff was redirected as well. All [community health workers, CHWs] working on other stuff were repurposed to cholera outbreaks.”

In 2013, MSPP and its partners launched a USD$2.2 billion strategy to eliminate cholera from Haiti (“National Plan for the Elimination of Cholera in Haiti”) while simultaneously overhauling the country’s public health system; however, by the end of 2014, 190 of the country’s 250 cholera treatment centers had closed and 60% of the remaining facilities lacked adequate infrastructure [44]. The eventual exodus of NGOs from Haiti’s health sector created a vacuum of health systems-strengthening resources and expertise: while as many as 400 organizations initially provided humanitarian aid, only 99 were conducting health activities as of 2011 [45].

In March 2010, MSPP and its partners published an Action Plan for National Recovery and Development. This Action Plan, alongside the country’s PDNA and cholera elimination plan, charted a path for health system recovery and enhancement, focusing primarily on reconstructing health facilities, rebuilding the country’s health workforce, and forging partnerships with the private sector to expand health service delivery. Though the cholera elimination plan briefly alludes to improving “provision of vaccines, cold chains, equipment, and other supplies” and details plans to eventually integrate cholera vaccination into the national childhood immunization schedule, other routine immunization concerns do not figure prominently in any of these recovery strategies [34,46,47].

In contrast to the cholera elimination plan, Haiti’s Expanded Program on Immunization (EPI) program developed a more detailed comprehensive multi-year plan (cMYP) for addressing immunization challenges following the 2010 earthquake. High-level priorities articulated in cMYP include improving immunization program governance; strengthening EPI capacities in rural, peri-urban, and other marginalized regions; and achieving financial sustainability to ensure long-term equitable access, quality, and safety of immunization programs [38]. cMYP also stated that EPI “should be used as a gateway to a minimum package of preventive, promotional and nutritional [services] targeting the dyad of the mother-child,” underscoring the need for integrated approaches to health service delivery [38]. Sufficient funding for these efforts, however, would rely heavily on external partners and donors, including the Pan-American Health Organization (PAHO), UNICEF, Gavi, USAID, the Japan International Cooperation Agency, and Haiti’s tripartite partnership with Cuba and Brazil [38].

MSPP also devised a National Post-Disaster Vaccination Plan with PAHO and UNICEF in 2010, which delineated a phased approach to increasing vaccination coverage and resurrecting routine immunization programs. In accordance with this plan, MSPP launched an integrated campaign in 2010 offering deworming tablets, Vitamin A supplementation, and vaccinations against measles, polio, diphtheria, pertussis, and tetanus. The first phase targeted residents of temporary settlements in the regions most affected by the earthquake, while the second phase expanded to all persons in these areas. By June 2010, over 900,000 people had been vaccinated, including 62% of the total population in the settlements and over 80% of children under five [48]. KI9 highlighted the logistical challenges associated with increasing routine coverage via campaigns, particularly as new vaccines were introduced into Haiti:

“[The campaigns] were a good start to get kids vaccinated in the age range they had to be vaccinated. If you miss that age range in a campaign, they’ll never get it. [But] then there was the push to add all these new vaccines…Then we had to know what rotavirus serotypes and diarrhea surveillance so we could assess impact from vaccination after it was introduced. We had to get cold chain back on board, since many fridges were not functional or destroyed after the earthquake. We had to monitor temperatures in the fridges before we could put vaccine in there. We had to worry about infection spreading in camps early on as well as importation of disease from people coming in.”

Tohme et al. further report that these campaigns achieved lower levels of coverage in the western, central, and Port-au-Prince metropolitan regions of the country, due to children being away from home when vaccinators arrived, or to caregivers being unaware of the campaign [49]. Gavi also reported that a lack of proactive communication and messaging around the importance and value of vaccination–combined with poor patient experiences with healthcare providers–further undermined vaccine demand among the campaign’s target populations [50]. Gavi further notes that forging public-private-civil society partnerships–for example, between the country’s EPI program, the Haitian Society of Pediatrics, the Haitian Red Cross, and the Haitian Platform for Civil Society Organisations to Strengthen Immunisation–could support improved immunization outcomes in the future [50].

Following the campaigns, MSPP embarked upon the third and final phase of the National Post-Disaster Vaccination Plan: jumpstarting the country’s national routine immunization program. KI8 shared that the U.S. Centers for Disease Control and Prevention (CDC), Brazil, Cuba, WHO, and UNICEF partnered with Haiti to place a medical consultant in each department who was tasked with supporting vaccination and surveillance (a department is a subnational administrative division, of which there are ten in Haiti. Haiti’s departments are further divided into 42 arondissements, 145 communes, and 571 communal sections). Though intended to inject expertise into subnational immunization structures, this measure did little to resolve lingering challenges around human resource management and financing: “We lacked staff in place to provide vaccinations and [among] department staff. We didn’t have many strong teams in terms of coordinating vaccination activities,” continued KI8. “These department coordinators were also in charge of other programs, too, like nutrition.” This observation is corroborated by Gavi, which describes insufficient technical coordination between departmental and central-level health authorities, difficulties scheduling regular meetings, and delayed reporting of statistical data during this period [50].

Elaborating further on Haiti’s fiscal woes, KI6 highlighted a fundamental misalignment between Haiti’s national health policy, donor priorities, and political will to conduct budgetary planning as the root cause of the country’s health financing challenges. KI8 also added, “The [immunization] program is owned by the partners. We did not see ownership at the national level, and they were not taking control of the immunization program. This was a big lack in Haiti, and it has to be addressed in order for there to be sustainability. We cannot just leave this problem to the partners.” Both Tohme et al. and Dowell et al. echo this observation, underscoring the need to institutionalize immunization expertise and increase government health spending in Haiti, particularly amid competing donor priorities [51,52]. In some cases, however, MSPP appears to have been deliberately excluded from decision-making, as KI1 shared:

“A lot of immunizations, routine or campaign, are being staffed by internationals, and very often, they do not speak Creole or French…If you are working on the ground–anything underneath the most senior level–you need to speak French or Creole…I’ve sat in meetings that were done in Spanish with no [MSPP] present, and they were taking key decisions within the public health sector for immunization…It’s extremely important that the language and cultural fit [are] there.”

The fragmentation of Haiti’s health governance across a vast constellation of stakeholders–each with varying agendas, resources, and levels of capacity–immediately sparked implementation challenges on the ground, particularly with respect to surveillance. Tohme et al. report that Haiti, with assistance from CDC, began scaling up surveillance systems in 2012, establishing a case-based system to monitor measles and rubella; four sentinel surveillance sites for rotaviral diarrhea; another sentinel surveillance system for meningitis; and an environmental surveillance system for poliovirus [51]. These efforts proved fruitful: by 2015, Haiti moved from being ranked the fourth-worst performing country in the Latin American and Caribbean region to the sixth-best in terms of investigating suspected cases of measles and rubella [51]. However, governance and funding challenges continued to undermine surveillance efforts [51,53].

Haiti also made significant progress in bolstering its public health laboratories. Its Laboratoire National de Santé Publique, established in 2006, initially lacked a strategic plan and focused primarily on HIV diagnostic capacities [53]. With support from the U.S. government, Haiti transformed its nascent laboratory network into a tiered, pyramidal system with expanded confirmatory testing capacities, a national strategic plan, training curricula for laboratory personnel, and forthcoming legal and regulatory frameworks for licensing, accreditation, and quality management [53,54]. However, with the near-entirety of the network’s funding coming from the President’s Emergency Plan for AIDS Relief–and the need to outsource equipment maintenance and repair to external contractors–the sustainability of this laboratory system remains uncertain [53].

In addition to laboratory and surveillance challenges, data deficits hindered routine immunization microplanning (i.e., activities to specify target populations for immunization, identify potential barriers to uptake, and develop workplans for vaccine delivery), vaccine forecasting, and measurement of vaccination coverage. KI3 reported that microplanning is largely supported by UNICEF and takes place at individual health facilities. “I have an Excel sheet and if you click on the name of the facility, you have all the information about microplanning,” they explained. “Microplanning is really well done, but the target population is the issue. Knowledge, skill, and experience goes into great planning, but if you don’t know the number of people you’re serving, your great microplanning doesn’t matter.”

Like many resource-constrained settings, Haiti struggles to estimate health service coverage due to outdated target population estimates [55]. Concurrently, while inaccurate population estimates compromise the denominator of a coverage calculation, poor documentation of vaccinations administered distorts the numerator, thereby producing artificially low coverage estimates. “To speak clearly, we don’t what vaccination coverage is, actually,” admitted KI3. “There is a data issue with big hospitals vaccinating lots of children and not reporting in the database. I know one hospital that vaccinates thousands of children per year that doesn’t report.”

Unreliable coverage estimates, in turn, complicate efforts to forecast vaccine supply and demand, a potentially costly challenge. “It’s also not how many [vaccines] you need, really,” KI1 pointed out. “It’s how many you can use, because if you don’t have a cold system, then what is going to be your trade-off? How many vaccines do you dare to distribute? Because you get an issue vaccinating with ineffective vaccine–with water–or you have to risk destroying vaccine, which is expensive. Even if the vaccine isn’t expensive, the logistics of getting it from the capital to the countryside is expensive.” Gavi further reports that insufficient data-sharing between departmental- and central-level authorities impedes immunization planning, “thereby not encouraging the emergence of strategies to improve immunisation coverage and equity in Haiti” [50].

Finally, workforce challenges–particularly compensation and job satisfaction–were major barriers to improving routine immunization. “Salaries are really low in the public sector, and it’s really a lot of work,” shared KI2, adding that “sometimes, at a health institution, you have very little staff expected to do everything. Any time something new comes in, then it’s added work. So, there’s constantly issues with workload unrelated to compensation and that does affect satisfaction and that’s at all levels from entry-level to management.” The near-constant, kaleidoscopic shifting of Haiti’s donor landscape has further destabilized the country’s health sector job market and fueled health worker discontent. MSPP’s overreliance on donors, for example, has triggered considerable health worker attrition from the public sector since private sector entities generally offer better wages and benefits [56]. Hashimoto et al. also report health worker dissatisfaction with placement in remote geographic areas, high turnover, and chronically delayed payments as additional challenges plaguing Haiti’s public sector health workforce [57].

Liberia

In December 2013, an index case of Ebola virus disease (EVD) was diagnosed in an eighteen-month-old boy in Guéckédou Prefecture, Guinea [58]. On March 23, 2014, following reports of 49 confirmed cases and 23 deaths in Guinea, WHO declared an outbreak [58]. The very next day, the Liberian Ministries of Information, Culture, Tourism, and Health announced six suspected cases of Ebola in the country, of whom five had already died [59]. Over the next two years, the outbreak rapidly escalated to 10,678 cases and 4,810 deaths in Liberia before authorities officially declared its end on June 1, 2016 [58].

Early in the epidemic, health officials in Liberia and their international partners created an Ebola Task Force to coordinate a swift response. But the Task Force soon proved unwieldy. “When EVD emerged, it took a political dimension in terms of leadership. There wasn’t a technical person providing insight but rather a political structure,” recalled KI14. “There was mixed messaging. There was conflicting information [until] the U.S. was able to intervene by…providing accurate information to the public in regard to EVD prevention and control. Then the government could change its strategy for control and prevention by bringing in and respecting the roles of the local leaders and practitioners.”

Liberian authorities ultimately adopted the Incident Management System (IMS) instead: a standardized protocol developed in the U.S. for coordinating emergency response activities [60]. Liberia chose to coordinate IMS activities through a new, donor-funded emergency operations center–which, after the Ebola epidemic, was used to monitor outbreaks of other vaccine-preventable diseases like meningitis [61,62]. Liberia’s President, Ellen Johnson Sirleaf, communicated frequently with the designated incident manager and established an advisory committee comprised of senior officials and international partners to guide response efforts [60].

KI21 also attributed Liberia’s post-epidemic success in routine immunization to IMS, stating, “The collaboration and coordination was difficult at the beginning of [Ebola]. In [the Ministry of Health and Social Welfare, MoHSW], there was the health coordinating committee, but they were very high level. They weren’t prepared for emergency response; they just [had] meetings. IMS worked, so we wondered if that [could] restructure the health care system, especially with community engagement being so critical.” Similarly, Brault et al. write, that “the Liberian government’s relationship with donors had evolved such that donors no longer drove the agenda, but rather accepted guidance from the government on priority areas and needs that the donors could assist with” [63].

The Ebola epidemic had immediate, destabilizing effects on routine immunization programs. When asked whether immunization activities continued during the early days of the outbreak, KI15 responded with an emphatic “no”: “Nowhere. Schools were closed, campaigns were withheld. Communities were not allowed to converge in large groups and health workers didn’t go into communities. If a mother voluntarily brought in her child for vaccination, then [the] child was vaccinated, but no campaigns took place during EVD.” Clarke et al. corroborate this observation, reporting that all planned outreach, vaccine introductions, campaigns, and supplemental immunization activities were halted. Additionally, MoHSW staff–many of whom were diverted from routine programs to Ebola response activities–were subsequently unable to implement EPI workplans. With fewer than 70% of health facilities open, fear of contracting EVD in healthcare settings also caused public demand for health services to plummet [64].

These setbacks sparked rapid declines in routine immunization coverage across Liberia (see Figs 2 and 5). Vaccination equity also suffered as a result. In 2013, 62.2% of Liberian children aged 24–35 months in the wealthiest quintile and 25.4% in the poorest quintile were fully immunized; in 2016, these estimates fell to 5.2% and 3.7%, respectively. [65] KI17 also highlighted geographic inequities, noting, “The biggest challenge was the issue of equity in immunization…When you dive deeper into the disaggregated data, there were still counties with low coverage.” Wesseh et al. echo this observation, finding that the counties most affected by Ebola (i.e., those reporting more than 70 Ebola deaths) reported 58% fewer fully immunized children during the epidemic; moderately affected counties (10–70 Ebola deaths) and least-affected counties (<10 Ebola deaths) reported reductions of 33% and 39%, respectively [66].

Given these declines in coverage, health authorities prioritized routine immunization activities even during the early days of the epidemic. Liberia’s post-Ebola routine immunization efforts also owe much of their success to proactive planning, effective leadership, and increased investment in health system recovery. As early as December 2014, Liberian health officials participated in a high-level meeting on strengthening health system resilience in Ebola-affected countries, followed by meetings with emergency response stakeholders to achieve consensus on recovery priorities [67]. Next, MoHSW created thematic working groups in alignment with components of WHO’s health system building blocks framework: leadership and governance; service delivery; financing; workforce; medical products, vaccines, and technologies; and information systems [68]. Each working group was comprised of MoHSW senior staff and external partners (including those outside the health sector), and regularly reported to the Cabinet of Liberia. As they liaised with senior MoHSW leaders, the working groups also identified priority areas for Ebola recovery [67].

These planning efforts, in turn, formed a robust policy foundation for post-epidemic health system recovery. Liberia’s Economic Stabilization and Recovery Plan, for example, explicitly connects the country’s economic recovery to health system recovery, reporting that between 2015 and 2017, USD$456 million would be spent on implementing an Investment Plan for Building a Resilient Health System (“the Investment Plan”). Activities included strengthening the health workforce, reengineering health infrastructure, epidemic preparedness and response systems, medical supply and diagnostics management, enhancement of quality delivery systems, information and research management, community engagement, leadership and governance, and financing systems [69].

The Investment Plan and several other policies and strategic plans–the National Health and Social Welfare Policy and Plan 2011–2021 (NHSWP), the National EPI Strategic Plan 2016–2021 (i.e., the comprehensive multi-year plan, cMYP), and the National Action Plan for Health Security (NAPHS)–all feature provisions for strengthening routine immunization services and systems in the wake of Ebola. NHSWP designates clinics as the main delivery points for routine immunization, reaffirms Liberia’s commitment to improving immunization coverage in low-performing jurisdictions via the WHO-endorsed Reaching Every District strategy, and supplementing routine programs with SIAs and National Immunization Days [15]. cMYP, meanwhile, features timelines, objectives, indicators, and cost estimates for increasing immunization coverage, improving cold chain capacities, eliminating stockouts, and strengthening the immunization workforce [70]. NAPHS costs out prioritized capacity-building activities (including roughly USD$4 million for immunization) and echoes cMYP’s commitment to scaling up coverage and human resource capacities [71]. Finally, Liberia’s 1976 Public Health Law–which was revised and approved in 2019 –includes a dedicated chapter on immunization, which specifies leadership roles and responsibilities, articulates guidelines for vaccine management, outlines vaccination requirements, and details financial arrangements for the EPI program [72].

Close alignment and linkages between these foundational documents, policies, and laws facilitated a cohesive approach to resurrecting Liberia’s routine immunization capacities. Yet, despite a strong policy foundation, Liberia’s deteriorating postwar infrastructure continued to hinder immunization. “The lack of infrastructure was terrible there–roads and electricity or lack thereof had the biggest effect on health systems…I’d never seen roads so bad,” recalled KI11. “There used to be electricity and hydro dams and waste treatment in the seventies, but it was all destroyed intentionally during the war. KI19 further underscored the importance of external partner support in overcoming infrastructural challenges, sharing, “With partnership from Gavi, UNICEF, WHO, there were a lot of trainings conducted at both the national and subregional levels, so people knew what to do. Technicians for cold chain were trained and retained and got logistics like motorcycles.” Cold chain challenges had previously encumbered vaccine management and delivery; Gavi, in fact, reported in 2014 that resource-shifting to accommodate the Ebola response caused cold chain equipment to break down, prompting UNICEF to dispatch repair teams [73,74]. Gavi support later enabled Liberia to train a cadre of cold chain officers, construct regional cold stores, and procure cold vans to facilitate vaccine delivery [75]. Between 2016 and 2018, Gavi also subsidized 248 solar direct drive refrigerators to expand the country’s cold chain capacities [75]. These and other Gavi funding streams were instrumental in implementing SIAs, increasing uptake of new and underused vaccines, and supporting urban and non-urban immunization strategies–core components of Liberia’s plan to ensure equitable coverage across all counties [75,76].

Notably, the Ebola epidemic also illuminated critical vulnerabilities in Liberia’s nascent disease surveillance systems. “We realized that we had to make a reform in the human resource structure for surveillance in Liberia,” recalled KI20. “We had to build capacity, look at infrastructure for public health surveillance and diagnostics, and the number of tests that we could conduct in Liberia was far less…Liberia could not perform tests for Lassa, EVD, or yellow fever–a good number of them except for measles.” Experts from MoHSW, WHO, and CDC eventually decided to overhaul Liberia’s Integrated Disease Surveillance and Response (IDSR) platform [77]. WHO originally conceptualized IDSR in 1998 to help African countries strengthen surveillance, laboratory, and response capacities in alignment with the International Health Regulations (2005), and the system had been adopted in Liberia in 2004, albeit without an implementation plan [77,78]. Post-Ebola, however, MoHSW and its partners developed both an implementation plan and a corresponding monitoring strategy [77].

The effort to revitalize IDSR ultimately proved fruitful: improved surveillance, coupled with robust community engagement, facilitated a successful measles immunization campaign among children under ten and improved early detection of both measles and acute flaccid paralysis following Ebola [79,80]. Liberia also adopted the Early Warning and Response Network (EWARN) system, a WHO-prescribed approach for gathering data on acute, rapid onset crises like epidemic-prone disease outbreaks [81]. However, Clarke et al. reported that the presence of parallel surveillance systems running alongside IDSR revealed discrepancies in the data being collected–a challenge also reported in other African countries [64].

Surveillance capacity-building dovetailed with strong commitments to accelerating social mobilization and expanding community outreach during the Ebola epidemic. Community-based surveillance, for example–wherein grassroots informants were enlisted to alert health authorities about suspicious illnesses or deaths–contributed effectively to reducing Ebola transmission [82]. Encouragingly, such protocols were institutionalized in routine public health practice, with health authorities later applying these approaches to measles surveillance and containment [79].

Rebuilding public trust in routine immunization services, after Ebola, however–particularly among the hardest-hit populations–proved to be a daunting challenge [83]. “It was difficult. No one was going up for surveillance or vaccine,” continued KI16. “People were not coming to the health facilities; they were afraid of [healthcare workers, HCWs] infecting the general public. HCWs were also afraid of the general public infecting them.” Liberia’s linguistic diversity further impeded immunization outreach, according to KI11: “People don’t speak the same languages fifteen minutes apart. Entirely different languages, not different dialects…You can’t even sell tomatoes to your neighbors. That makes problems for vaccinators and nurses because they can’t talk to their patients, there’s no common language. How are you supposed to do health education without a common language?”

Confronted with the task of scaling up trust across linguistic barriers, public health authorities coupled mass messaging approaches with grassroots strategies adapted to local contexts. In this vein, KI14 highlighted the role of the country’s postwar peacebuilding infrastructure in supporting health communication, noting that it facilitated dialogue with chiefs in high-risk areas. KI14 also shared that targeted demand generation and awareness-building strategies helped increase vaccine uptake. These included establishing immunization sites in marketplaces, where women with children often worked or shopped; enlisting town criers; broadcasting UNICEF radio programming; and coordinating social media campaigns in support of immunization. KI11 corroborated these examples, sharing, “That was a major thing–building outreach into people’s schedules, linking to [community health workers, CHWs], which were introduced as a formal policy, and pairing with them to plan these outreach events.” On this point, Liberia’s National Community Health Services Policy–originally introduced in 2008, revised in 2011, and renewed in 2016 –established standards for community outreach, health promotion, and referral activities [84].

Importantly, officials also took steps toward strengthening post-epidemic health governance and sustaining political will around immunization. President Sirleaf recognized the gravity of the epidemic early on and prioritized outbreak response efforts, describing Ebola as a threat to the country’s “economic and social fabric” [85]. Writing about Ebola in 2014, she also called for greater investment in Liberia’s health infrastructure, referencing setbacks in routine immunization programming and predicting a resurgence of vaccine-preventable diseases [86]. A strong advocate for community health, President Sirleaf also launched a national health assistance program to serve over 4,000 communities in the remotest parts of the country following the epidemic [87].

The Liberian government further reified its commitments to routine immunization with key structural reforms and financial support. “Because [of] the introduction of yellow fever and pentavalent [vaccines], the Government of Liberia had to commit to co-finance the introduction of these two vaccines, and that has been sustained over the years,” observed KI20. “The government has also demonstrated increased visibility of their support of the immunization program, as demonstrated by budgetary commitments annually to immunization and immunization products.” In this vein, the Investment Plan articulated a strategy to formally ensconce IMS, Ebola-specific community health task forces, and other Ebola coordinating mechanisms within the country’s health sector [88]. The government also strengthened referral mechanisms between Ebola treatment units and the rest of the country’s health system, later developing a plan to decommission these units and transform them into permanent health facilities [88].

Notably, the Liberian government implemented several policy reforms to support post-epidemic recovery. For example, in a departure from the previously established donor-supported financial pooling mechanism for health, the Investment Plan also proposed establishing a government-led equity fund intended to “ensure financial risk protection, cushion against financial risks that limit access to care, and address systemic issues within existing provider payment mechanisms” [88]. MoHSW also provided targeted technical assistance to counties with persistently low levels of coverage–an approach dubbed “Parenting of Poorly Performing Counties” [89].

Though efforts to improve routine immunization coverage following the Ebola epidemic achieved significant progress, several challenges remain. A 2017 audit, for example, showed that IDSR data was not being used to support decision-making at health facilities; many facilities surveyed also reported weak Internet connectivity, electricity outages, and limited access to mobile phones and computers [90]. Additional challenges relate to the management, training, compensation, and retention of Liberia’s health workforce. Here, Liberia reported high attrition among health workers assigned to the southeastern region of the country due to difficult living and working conditions [75]. Additionally, Gavi reported in 2017 that while some 1,110 health workers had been trained in immunization as part of the country’s Ebola recovery efforts, Liberia’s health sector had only 795 working vaccinators, roughly 25% of whom were on government payroll. In fact, as many as 41% of Liberia’s public sector health workers went on strike during the Ebola epidemic to protest their exclusion from the government payroll, prompting the World Bank, African Development Bank, and United Nations Development Programme to help subsidize hazard pay [91].

Cross-case analysis

Analysis of variance.

Our one-way repeated measures ANOVA revealed several statistically significant differences between Haiti and Liberia in terms of the proportion of districts reporting 80% or higher coverage of MCV1 (F[10, 9], p = 0.0491), domestic government health expenditure per capita (F[10, 9], p = 0.00), and external health expenditures per capita (F[10, 9], p = 0.0007) during the five years preceding and following their respective epidemics. However, there were no significant differences between Liberia and Haiti in terms of the proportion of districts reporting 80% or greater coverage of DTP3 or dropout rates between DTP3 and the MCV1. In Haiti, the average proportion of districts reporting greater than 80% MCV1 coverage decreased considerably in the five years following the onset of its cholera epidemic. This period also saw a slight decrease in average domestic government health spending and larger increases in average vaccination dropout rates and external health spending. Liberia reported a slightly lower average proportion of districts reporting greater than 80% MCV1 coverage in the five years following its Ebola epidemic, along with a slight decrease in average government health expenditures and a doubling of external health expenditures; notably, average dropout rates during this period also decreased (see S1 Table).

Stacked cases.

S2 Table–which presents a matrix displaying the findings from each case stacked side-by-side, organized within the Essential Public Health Services framework–facilitates comparison between the post-epidemic recovery experiences of Liberia and Haiti by disaggregating findings across relevant domains of health system functioning (i.e., assessment, policy development, and assurance). Per the Framework, the assessment domain relates to routinely monitoring population health and investigating potential health hazards. Following their respective epidemics, both Haiti and Liberia adopted robust case-based approaches to surveilling vaccine-preventable diseases. In Liberia, however, the IDSR and EWARN systems–coupled with strong case reporting mechanisms, targeted assistance to underperforming counties, and community-based surveillance systems–contributed to better immunization outcomes long after the Ebola epidemic. Though Haiti established a national reference laboratory and developed an accompanying strategic plan, limited availability of equipment and high maintenance costs threaten its fiscal sustainability.

The Framework’s policy development domain encompasses effective communication and health education, community mobilization, policy formulation and implementation, and legal and regulatory measures to promote health. In Liberia, a combination of top-down and grassroots-level communication strategies–coupled with active outreach to last mile communities–played an important role in recouping losses in routine immunization coverage. By contrast, efforts to promote post-cholera routine immunization in Haiti floundered; patient dissatisfaction with immunization service quality at health facilities further diminished public demand for these services. Despite strong relationships with external donors and international organizations, Haiti also struggled to mobilize partnerships with domestic civil society groups well-poised to promote immunization, such as the Haitian Red Cross. Like Haiti, Liberia also sustained strong relationships with international donors; additionally, it excelled at forging partnerships with community champions and civil society organizations, which proved consequential to improving post-Ebola immunization coverage.

The two countries also differed considerably in terms of post-epidemic health system policy formulation. Numerous Liberian policies, strategic plans, and laws demonstrated strong alignment in their vision for a more resilient post-Ebola health system, and several included specific provisions for improving routine immunization. The majority of Haiti’s post-cholera plans and policies, by contrast, did not mention immunization or explicitly articulate strategies for improving coverage beyond the Post-Disaster Vaccination Plan or the EPI program’s cMYP.

The final domain of the Framework, assurance, addresses the importance of ensuring equitable access to needed services, supporting a diverse and skilled health workforce, sustaining a strong organizational infrastructure for public health, and strengthening public health functions through evaluation, research, and continuous quality improvement. Access to immunization services in Haiti was often impeded by violence, user fees, stockouts, long wait times, and lack of referral mechanisms to primary care facilities. Parallel challenges were observed in other realms of public infrastructure in Haiti, where weak transportation and sanitation systems, weak cold chain capacities, and complex land ownership laws hindered efforts to establish permanent mechanisms for vaccine delivery. Though Liberia experienced similar infrastructural challenges, it still managed to strengthen referral mechanisms between Ebola treatment units and primary care facilities, scale up delivery of its Essential Package of Health Services, and establish a National Public Health Institute to inform long-term health systems-strengthening activities.

Despite differing trajectories of post-epidemic immunization coverage, Haiti and Liberia share a critical weakness: health workforce dissatisfaction. Health workers in both countries–including vaccinators and community workers supporting routine immunization programs–were often unhappy with their training, compensation, and geographic placement. In both countries, the epidemic in question diverted health workers from routine service provision, including immunization. Difficult working conditions and more lucrative offers from donor-funded campaigns resulted in health worker attrition from the public sector. Additionally, despite strong microplanning capacities, both countries reported major challenges in data management, estimating immunization coverage, and forecasting vaccine demand. Left unresolved, these shared challenges will likely hinder efforts to achieve and sustain high levels of routine immunization coverage, as well as coordinate new vaccine introductions in the future.

Emergent themes.

In addition to the domains of the Framework, we identified several other similarities and differences between the two cases relating to the roles of colonialism in shaping health systems, the importance of country ownership and autonomy in matters of health governance, and the role of integration in facilitating post-epidemic recovery (see S4 Appendix for relevant quotes).

Historical injustice is a powerful driver of contemporary inequity. Extractive colonialist practices–military occupation, extortion, distortion of national priorities, and undermining of political authority–have done significant harm to populations and health systems in Haiti and Liberia. Additionally, the centuries-long depletion of social, financial, and political capital initially paralyzed response and long-term recovery efforts in both settings (see S5 Appendix). As political theorist Peer Illner has commented, “[disaster relief] has passed from the domain of state-led, paid reproductive work to the sphere of unwaged reproductive labour. This recent trend has been threefold: exposing communities to disaster by eroding their conditions of life through austerity; abandoning them to survive on their own; then selling off what remains of public relief infrastructures to commercial operators, once the immediate threat has receded” [92]. Illner’s observations mirror the colonial patterns of encroachment and extraction observed in both countries, but especially during the aftermath of the earthquake and cholera in Haiti, wherein nonstate actors commandeered aid flows, outsourced or privatized state capacities, and eschewed government autonomy in deference to donor preferences, all in the name of providing aid and relief.

Both cases also underscored the importance of government autonomy and ownership of health programs as consequential to population health and well-being. As seen in both countries but particularly in Haiti, the implementation of vertical, donor-driven health initiatives in a vacuum of state capacity often weakens public sector agency, credibility, and autonomy; creates an economy of overreliance on external aid to subsidize public goods, including common goods for health; undercuts public trust in a government’s ability to fulfill its social contract; and, in some cases, may actually undermine efforts to develop, operationalize, and institutionalize knowledge, expertise, and capital within the public sector of the recipient country [93]. On this note, Noor adds, “Your help is needed, your ideas are welcome, but the solutions to country problems must be arrived at by countries themselves. Ethical partners know theirs is a supportive role” [94].

Though the literature and interviewees offered critiques of both Liberian and Haitian leadership and donor-driven health initiatives were prevalent in both countries, MoHSW appears to have secured a far greater degree of ownership and autonomy over Ebola response and health system recovery efforts than its MSPP counterparts following the cholera epidemic. By devising a plan to vest control of health financing within its own government and embedding Liberian leaders and experts within donor-funded response and recovery mechanisms, Liberia was able to rapidly scale up national immunization coverage while drastically reducing inequities. The ethos of centering Liberian leadership and technical knowledge shaped nearly all aspects of response and recovery, from revitalizing IDSR and formulating the Investment Plan to implementing IMS and prioritizing community health. Political leaders’ firm commitment to improving immunization and community health capacities–which, in turn, was underpinned by programmatic and financial support–was also instrumental in achieving this. By contrast, the sidelining of MSPP in Haiti and fragmentation of financial and decision-making power across a slew of external actors obstructed cohesive action around immunization. Furthermore, the absence of a unified government response to the cholera epidemic impeded priority-setting, policymaking, and budgeting activities required for long-term immunization program recovery.

From health system ownership and autonomy follows integration: the alignment of health system leaders, priorities, funding streams, policies, workforces, and external stakeholders across a full spectrum of comprehensive health service provision [95]. Liberia’s post-epidemic immunization model–wherein targeted campaigns were not the primary modes of vaccination, but rather supplemented EPHS delivery–resulted in greater coverage compared to Haiti, where standalone vaccination campaigns were implemented largely in isolation from other primary health services. Furthermore, Liberia achieved clear alignment across the various plans, policies, priorities, and budgets guiding immunization program recovery. By contrast, limited planning and budgeting capacities in Haiti, the omission of routine immunization from key strategic plans, and the predominance of external decision-makers and consultants indicate a less-integrated approach to enhancing post-cholera immunization coverage.

Discussion

This investigation examined the factors contributing to equitable post-epidemic routine immunization coverage in Liberia and Haiti. Lessons learned from past emergencies–infectious disease outbreaks, natural disasters, manmade catastrophes, and others–suggest that health systems should ideally possess the ability to scale up robust horizontal capacities for routine service provision to meet the demands of emergent crises [96]. Yet, the divergent trajectories of post-epidemic routine immunization program recovery in these countries illustrate how such logic often fails in resource-constrained settings, where baseline health system capacities may be weak or missing altogether. We found that achieving strong alignment between immunization policies, integrating routine immunization into robust systems of primary care, and respecting country ownership and autonomy over health system functioning were essential to improving equitable immunization coverage in Liberia. By contrast, the absence of these factors may have contributed to widening coverage disparities in Haiti.

While the specific approaches adopted in these countries may not be universally applicable in every low- or middle-income setting, or after every type of infectious disease outbreak, this study did generate important insights about the facilitators and deterrents of routine immunization program recovery following major epidemics. These insights, in turn, may be transferrable to other resource-constrained settings characterized by weak primary care systems, a heavy reliance on external aid to subsidize both routine and emergency health system activities, and a strong donor presence. Political leaders and domestic health authorities in affected countries should conduct long-term planning to ensure alignment between budgets, plans, and routine immunization programs; treat routine immunization and community health systems as critical national priorities worthy of sustained, long-term investment; strengthen linkages between various health system components; and improve compensation structures and working conditions for public-sector health workforces. Meanwhile, donors and other external stakeholders should strive to embed local expertise and leadership within vertical response and recovery structures, promote country ownership of domestic health programs, and work with in-country political leaders to support long-term budgetary and policy planning around routine immunization, community health, and primary care.

This investigation does have some limitations. First, none of the investigators speak, read, or write French, Haitian Creole, or any non-English language spoken in either Haiti or Liberia with enough proficiency to analyze relevant documents produced in these languages. Similarly, we were unable to interview key informants unless they could converse in English. A second limitation relates to the types of key informants recruited for this study: nearly every interviewee consulted about Haiti was or is currently affiliated with donor agencies that responded to the earthquake and cholera epidemic. However, we were unable to secure many interviews with individuals affiliated with MSPP or Haitian-led organizations. Conversely, most informants interviewed about Liberia were Liberian nationals either currently or formerly affiliated with public-sector institutions that responded to the Ebola epidemic, while few represented donor agencies or external partners. As a result, our findings for both countries do not account for demand-side or end-user perspectives (e.g., from patients) on immunization program recovery, and in the case of Haiti, they do not sufficiently reflect public-sector perspectives (e.g., from MSPP). Furthermore, we identified very few peer-reviewed studies and grey literature documents featuring Haitian authorship; Liberian MoHSW authors, by contrast, were comparatively well-represented in published scholarship on Ebola and routine immunization. Given these omissions, a relatively low response rate among interviewees (21 interviews granted out of 80 invited), and the language barriers, it is likely that valuable perspectives on immunization and health system recovery are missing from both cases–particularly Haitian perspectives. These gaps indicate important areas for future inquiry.

The Essential Public Health Services framework was an intuitive tool in terms of articulating a set of basic organizing principles for health systems and providing a common vernacular for discussing recovery across diverse health system stakeholders. However, it also has some limitations, which became apparent over the course of this investigation. First, the Framework appears to be conceptual in design rather than analytical; as such, it does not indicate how individual essential services should be weighted relative to one another, nor does it suggest how they should be organized, the time required to establish said services, or the order in which stakeholders should pursue them. Furthermore, as Fitter et al. note in their analysis of public health system recovery in Haiti, the Framework does not explicitly account for health governance, political will, leadership, or financing [23]. Perhaps these were envisioned as cross-cutting competencies or considerations rather than essential “services”; if so, a clearer statement of the assumptions underpinning the Framework would be valuable.

Accompanying Framework guidance states, “To achieve equity, the Essential Public Health Services actively promote policies, systems, and overall community conditions that enable optimal health for all and seek to remove systemic and structural barriers that have resulted in health inequities.” The Framework positions equity as the core of the ten essential services but makes no mention of ethics or justice beyond this stated purpose. Nevertheless, by deeming certain services “essential,” the Framework makes implicit normative judgements about their value without explicitly considering structural factors–such as state capacities and colonial legacies–that shape their availability, provision, and utilization. Finally, the Framework does not clearly explicate linkages between individual essential services. Mounier-Jack et al. present similar critiques of WHO’s health system building blocks model–which, like the Framework, does not account for demand-side considerations associated with health service provision or structures of power and decision-making [97]. Thus, practitioners and policymakers might consult the Framework to arrive at a common understanding of health system needs and priorities following a major crisis, but may find it less useful as an operational tool for guiding health system recovery efforts.

To assess the confirmability of this investigation, follow-on case studies might examine post-epidemic immunization programs in other settings to determine whether similar barriers and facilitators of recovery exist. Coupling other methodological frameworks, such as a positive deviance lens, with additional forms of data (e.g., social media content, financial data, mobile data) and modes of data collection (e.g., focus groups, community-based participatory research, surveys) could also yield rich insights into demand-side immunization considerations [98]. Future analyses might also compare perspectives across sectors and stakeholders (e.g., donors, NGOs, public-sector health institutions, patients) to paint a more comprehensive picture of post-epidemic recovery. Additionally, a formal power analysis of post-epidemic health system reforms could elucidate how relationships between donors, policymakers, practitioners, and communities shape population health outcomes following major crises [99].

Conclusion

As the world continues to navigate the COVID-19 pandemic, our findings may be especially salient for health practitioners working to reverse population health setbacks and ensure the continuity of core public health programs like routine immunization. For example, donors might consider earmarking a portion of emergency response funds toward ensuring the continuity of routine immunization programs and integrating COVID-19 vaccination capacities into primary care systems, while ministerial and subnational health officials should explicitly incorporate these considerations into pandemic response and recovery plans. As Haiti and Liberia’s experiences with large-scale epidemics have shown, decision-makers and donors in LMICs play particularly important roles in course-correcting health systems struggling to meet the demands of public health emergencies, often at the expense of providing core primary health services. How these stakeholders coordinate both intra- and post-crisis recovery efforts will shape future trajectories of population health and health equity.

Supporting information

S1 Table. Pre- & post-epidemic immunization coverage & health spending in Haiti and Liberia.

https://doi.org/10.1371/journal.pone.0292793.s001

(DOCX)

S2 Table. Matrix of stacked cases using the Essential Public Health Services framework.

https://doi.org/10.1371/journal.pone.0292793.s002

(DOCX)

S1 Appendix. Literature and data search strategy.

https://doi.org/10.1371/journal.pone.0292793.s003

(DOCX)

S3 Appendix. Characteristics of key informants interviewed.

https://doi.org/10.1371/journal.pone.0292793.s005

(DOCX)

S4 Appendix. Key informant quotes mapped against components of the Essential Public Health Services framework.

https://doi.org/10.1371/journal.pone.0292793.s006

(DOCX)

S5 Appendix. Historical contexts of Haiti and Liberia.

https://doi.org/10.1371/journal.pone.0292793.s007

(DOCX)

Acknowledgments

The research team is grateful to Hannah Ottman-Feeney for providing administrative support, as well as to the subject matter experts who graciously agreed to participate in key informant interviews.

References

  1. 1. Kruk ME, Myers M, Varpilah ST, Dahn BT. What is a resilient health system? Lessons from Ebola. Lancet Lond Engl. 2015 May 9;385(9980):1910–2. pmid:25987159
  2. 2. Jones SA, Gopalakrishnan S, Ameh CA, White S, van den Broek NR. “Women and babies are dying but not of Ebola”: the effect of the Ebola virus epidemic on the availability, uptake and outcomes of maternal and newborn health services in Sierra Leone. BMJ Glob Health. 2016;1(3):e000065. pmid:28588954
  3. 3. Hogan AB, Jewell BL, Sherrard-Smith E, Vesga JF, Watson OJ, Whittaker C, et al. Potential impact of the COVID-19 pandemic on HIV, tuberculosis, and malaria in low-income and middle-income countries: a modelling study. Lancet Glob Health. 2020 Sep;8(9):e1132–41. pmid:32673577
  4. 4. Schoch-Spana M. An Epidemic Recovery Framework to Jump-start Analysis, Planning, and Action on a Neglected Aspect of Global Health Security. Clin Infect Dis Off Publ Infect Dis Soc Am. 2020 Nov 1;71(9):2516. pmid:32348449
  5. 5. Mustafa S, Zhang Y, Zibwowa Z, Seifeldin R, Ako-Egbe L, McDarby G, et al. COVID-19 Preparedness and Response Plans from 106 countries: a review from a health systems resilience perspective. Health Policy Plan. 2022 Feb 8;37(2):255–68. pmid:34331439
  6. 6. Rodriguez DC, Neel AH, Mahendradhata Y, Deressa W, Owoaje E, Akinyemi O, et al. The effects of polio eradication efforts on health systems: a cross-country analysis using the Develop-Distort Dilemma. Health Policy Plan. 2021 Jun 3;36(5):707–19. pmid:33882118
  7. 7. Griffiths UK, Mounier-Jack S, Oliveira-Cruz V, Balabanova D, Hanvoravongchai P, Ongolo P. How can measles eradication strengthen health care systems? J Infect Dis. 2011 Jul;204 Suppl 1:S78–81. pmid:21666217
  8. 8. Orenstein WA, Seib K. Beyond vertical and horizontal programs: a diagonal approach to building national immunization programs through measles elimination. Expert Rev Vaccines. 2016 Jul;15(7):791–3. pmid:26967373
  9. 9. World Health Organization. WHO vaccine-preventable diseases: monitoring system. 2020 global summary [Internet]. World Health Organization. World Health Organization; [cited 2022 Feb 26]. https://apps.who.int/immunization_monitoring/globalsummary/indicators/
  10. 10. Seawright J, Gerring J. Case Selection Techniques in Case Study Research: A Menu of Qualitative and Quantitative Options. Polit Res Q. 2008 Jun 1;61(2):294–308.
  11. 11. World Health Organization. Disease Outbreak News [Internet]. World Health Organization. [cited 2022 Feb 19]. https://www.who.int/emergencies/disease-outbreak-news
  12. 12. U.S. Central Intelligence Agency. Liberia—The World Factbook [Internet]. [cited 2022 Feb 19]. https://www.cia.gov/the-world-factbook/countries/liberia/
  13. 13. U.S. Central Intelligence Agency. Haiti—The World Factbook [Internet]. The World Factbook. 2022 [cited 2022 Feb 19]. https://www.cia.gov/the-world-factbook/countries/haiti/
  14. 14. Pan American Health Organization. Haiti: Profile of the Health Services System [Internet]. 2003 [cited 2022 Feb 19]. https://www.paho.org/hq/dmdocuments/2010/Health_System_Profile-Haiti_2003.pdf
  15. 15. Ministry of Health and Social Welfare. National Health and Social Welfare Policy and Plan 2011–2021 [Internet]. 2011 [cited 2022 Feb 19]. http://moh.gov.lr/wp-content/uploads/National-Health-Policy-Plan-MOH-2011-2021.pdf
  16. 16. U.S. Agency for International Development, U.S. Department of State. Liberia [Internet]. ForeignAssistance.gov. [cited 2022 Feb 19]. https://foreignassistance.gov/cd/liberia/
  17. 17. U.S. Agency for International Development, U.S. Department of State. Haiti [Internet]. ForeignAssistance.gov. [cited 2022 Feb 19]. https://foreignassistance.gov/cd/haiti/
  18. 18. Rowley J. Using case studies in research. Manag Res News. 2002 Jan 1;25(1):16–27.
  19. 19. Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Inf Libr J. 2009;26(2):91–108. pmid:19490148
  20. 20. Garritty C, Gartlehner G, Nussbaumer-Streit B, King VJ, Hamel C, Kamel C, et al. Cochrane Rapid Reviews Methods Group offers evidence-informed guidance to conduct rapid reviews. J Clin Epidemiol. 2021 Feb;130:13–22. pmid:33068715
  21. 21. CEBMa Center for Evidence-Based Management. CEBMa Guideline for Rapid Evidence Assessments in Management and Organizations [Internet]. 2017. https://www.cebma.org/wp-content/uploads/CEBMa-REA-Guideline.pdf
  22. 22. The Public Health National Center for Innovations. The 10 Essential Public Health Services [Internet]. 2020 [cited 2022 Feb 19]. https://phnci.org/uploads/resource-files/EPHS-English.pdf
  23. 23. Fitter DL, Delson DB, Guillaume FD, Schaad AW, Moffett DB, Poncelet JL, et al. Applying a New Framework for Public Health Systems Recovery following Emergencies and Disasters: The Example of Haiti following a Major Earthquake and Cholera Outbreak. Am J Trop Med Hyg. 2017 Oct 18;97(4 Suppl):4. pmid:29064359
  24. 24. Clay LA, Stone KW, Horney JA. Quantifying Disaster Impacts on Local Public Health Agency’s Leadership, Staffing, and Provision of Essential Public Health Services. Disaster Med Public Health Prep. 2021 Aug 16;1–6. pmid:34396948
  25. 25. Mainzer HM, Kruger J, Mahany M. Essential Public Health Services Framework: Use for Rebuilding Communities. Am J Public Health. 2019 Sep;109(S4):S271–3. pmid:31505146
  26. 26. Sellers K, Fisher JS, Kuehnert P, Castrucci BC. Meet The Revised 10 Essential Public Health Services: Developed By The Field, Centering Equity [Internet]. Health Affairs. 2021. https://www.healthaffairs.org/do/10.1377/forefront.20210319.479091/full/
  27. 27. NVivo [Internet]. QSR International Pty Ltd.; 2018. https://www.qsrinternational.com/nvivo-qualitative-data-analysis-software/home?_ga=2.147149623.1834575441.1645928993-1997246167.1645928993
  28. 28. Miles MB, Huberman AM, Saldaña J. Qualitative Data Analysis: A Methods Sourcebook [Internet]. 4th ed. Washington, D.C.: SAGE Publications, Inc.; 2022 [cited 2022 Feb 19]. https://us.sagepub.com/en-us/nam/qualitative-data-analysis/book246128
  29. 29. Stata Statistical Software: Release 17. College Station, TX, USA: StataCorp; 2021.
  30. 30. Nowell LS, Norris JM, White DE, Moules NJ. Thematic Analysis: Striving to Meet the Trustworthiness Criteria. Int J Qual Methods. 2017 Dec 1;16(1):1609406917733847.
  31. 31. Pallardy R. 2010 Haiti earthquake. In: Britannica [Internet]. 2022 [cited 2022 Feb 20]. https://www.britannica.com/event/2010-Haiti-earthquake
  32. 32. O’Connor MR. Two Years Later, Haitian Earthquake Death Toll in Dispute—Columbia Journalism Review [Internet]. Columbia Journalism Review. 2016 [cited 2022 Feb 20]. https://web.archive.org/web/20160130060859/http://www.cjr.org/behind_the_news/one_year_later_haitian_earthqu.php?page=all
  33. 33. Renois C. Haitians angry over slow aid [Internet]. The Age. 2010 [cited 2022 Feb 20]. https://web.archive.org/web/20100207005409/http://www.theage.com.au/world/haitians-angry-over-slow-aid-20100204-ng2g.html
  34. 34. Government of the Republic of Haiti. Haiti Earthquake PDNA: Assessment of damage, losses, general and sectoral needs [Internet]. 2010 [cited 2022 Feb 20]. https://reliefweb.int/sites/reliefweb.int/files/resources/C8D475D8DBEDAEFD49257705000819F9-Full_Report.pdf
  35. 35. Gage AD, Leslie HH, Bitton A, Jerome JG, Thermidor R, Joseph JP, et al. Assessing the quality of primary care in Haiti. Bull World Health Organ. 2017 Mar 1;95(3):182. pmid:28250531
  36. 36. Health Finance & Governance. Haiti Health Workforce Data Audits Lead to Human Resources for Health Improvements [Internet]. [cited 2022 Feb 20]. https://www.hfgproject.org/health-workforce-data-audits-lead-improvements-human-resources-health-haiti/
  37. 37. World Health Organization. Data Explorer [Internet]. Global Health Expenditure Database. [cited 2022 Feb 20]. https://apps.who.int/nha/database/Select/Indicators/en
  38. 38. Ministry of Public Health and Population. Expanded Programme on Immunization Comprehensive Multi-Year Plan cMYP-EPI-2011-2015 [Internet]. 2011 [cited 2022 Feb 20]. http://caribbeanelections.com/eDocs/strategy/ht_strategy/ht_Immunization_Multiyear_Plan_2011_2015.pdf
  39. 39. Cayemittes M, Placide MF, Mariko S, Barrère B, Sévère B, Alexandre C. Haïti Enquête Mortalité, Morbidité et Utilisation des Services 2005–06 (Haiti DHS, 2005–06—Final Report) [Internet]. Pétion-Ville, Haïti: Institut Haïtien de l’Enfance; 2007 Jan [cited 2022 Feb 20]. https://dhsprogram.com/pubs/pdf/FR192/FR192.pdf
  40. 40. Barzilay EJ, Schaad N, Magloire R, Mung KS, Boncy J, Dahourou GA, et al. Cholera surveillance during the Haiti epidemic—the first 2 years. N Engl J Med. 2013 Feb 14;368(7):599–609. pmid:23301694
  41. 41. Weinmeyer R. Pursuing Justice in Haiti’s Cholera Epidemic. AMA J Ethics. 2016 Jul 1;18(7):178–726. pmid:27437822
  42. 42. Cholera Outbreak—Haiti, October 2010 [Internet]. [cited 2022 Feb 20]. https://www.cdc.gov/mmwr/preview/mmwrhtml/mm5943a4.htm
  43. 43. Centers for Disease Control and Prevention (CDC). Cholera in Haiti [Internet]. 2021 [cited 2022 Feb 20]. https://www.cdc.gov/cholera/haiti/index.html
  44. 44. Lucien MAB, Adrien P, Hadid H, Hsia T, Canarie MF, Kaljee LM, et al. Cholera Outbreak in Haiti: Epidemiology, Control, and Prevention. Infect Dis Clin Pract. 2019 Jan;27(1):3–11.
  45. 45. Pan American Health Organization. Health Cluster [Internet]. [cited 2022 Feb 20]. https://www.paho.org/disasters/dmdocuments/HAITI-Fact-Sheets-05-Health%20Cluster.pdf
  46. 46. Government of the Republic of Haiti. Action Plan for National Recovery and Development of Haiti: Immediate Key Initiatives for the Future [Internet]. 2010 [cited 2022 Feb 20]. https://www.haitireconstructionfund.org/system/files/Haiti%20Action%20Plan.pdf
  47. 47. Ministry of Public Health and Population, National Directorate for Water Supply and Sanitation. National Plan for the Elimination of Cholera in Haiti 2013–2022 [Internet]. 2013. https://www.paho.org/hq/dmdocuments/2013/cholera-haiti-nat-plan-elim-2013-2022.pdf
  48. 48. Pan American Health Organization. Vaccination and Immunization [Internet]. [cited 2022 Feb 20]. https://www.paho.org/disasters/dmdocuments/HAITI-Fact-Sheets-09-Vaccination.pdf
  49. 49. Tohme RA. Measles and Rubella Vaccination Coverage in Haiti, 2012: Implications for Maintaining Measles and Rubella Elimination. In American Academy of Pediatrics; 2013 [cited 2022 Feb 20]. https://aap.confex.com/aap/2013/webprogrampress/Paper21493.html
  50. 50. Gavi, the Vaccine Alliance. Rapport de l’évaluation conjointe (JA) 2018 [Internet]. 2018 [cited 2022 Feb 20]. https://www.gavi.org/sites/default/files/document/rapport-de-l-%25C3%25A9valuation-conjointe-haiti-2018pdf.pdf
  51. 51. Tohme RA, Francois J, Cavallaro KF, Paluku G, Yalcouye I, Jackson E, et al. Expansion of Vaccination Services and Strengthening Vaccine-Preventable Diseases Surveillance in Haiti, 2010–2016. Am J Trop Med Hyg. 2017 Oct 18;97(4 Suppl):28. pmid:29064356
  52. 52. Dowell SF, Tappero JW, Frieden TR. Public health in Haiti—challenges and progress. N Engl J Med. 2011 Jan 27;364(4):300–1. pmid:21219131
  53. 53. Louis FJ, Buteau J, Boncy J, Anselme R, Stanislas M, Nagel MC, et al. Building and Rebuilding: The National Public Health Laboratory Systems and Services Before and After the Earthquake and Cholera Epidemic, Haiti, 2009–2015. Am J Trop Med Hyg. 2017 Oct 18;97(4 Suppl):21. pmid:29064354
  54. 54. Ministère de la Santé Publique et de la Population. Plan Stratégique Quinquennal du Réseau National de Laboratoires 2010–2015 [Internet]. 2010 [cited 2022 Feb 20]. http://www.mspp.gouv.ht/site/downloads/version%20finalisee%20Plan%20Strategique.pdf
  55. 55. Harrison K, Rahimi N, Carolina Danovaro-Holliday M. Factors limiting data quality in the expanded programme on immunization in low and middle-income countries: A scoping review. Vaccine. 2020 Jun 19;38(30):4652–63. pmid:32446834
  56. 56. Kristoff M, Panarelli L. Haiti: A Republic of NGOs? [Internet]. Washington, D.C.: United States Institute for Peace; 2010 Apr [cited 2022 Feb 20]. Report No.: 23. https://www.usip.org/sites/default/files/resources/PB%2023%20Haiti%20a%20Republic%20of%20NGOs.pdf
  57. 57. Hashimoto K, Adrien L, Rajkumar S. Moving Towards Universal Health Coverage in Haiti. Health Syst Reform. 2020;6(1):e1719339. pmid:32101069
  58. 58. U.S. Centers for Disease Control & Prevention. 2014–2016 Ebola Outbreak in West Africa [Internet]. Centers for Disease Control & Prevention. 2020 [cited 2022 Feb 20]. https://www.cdc.gov/vhf/ebola/history/2014-2016-outbreak/index.html
  59. 59. Timeline [Internet]. Global Ebola Response. 2014 [cited 2022 Feb 20]. https://ebolaresponse.un.org/timeline
  60. 60. Nyenswah TG, Kateh F, Bawo L, Massaquoi M, Gbanyan M, Fallah M, et al. Ebola and Its Control in Liberia, 2014–2015. Emerg Infect Dis. 2016 Feb;22(2):169. pmid:26811980
  61. 61. U.S. Mission Liberia. Embassy, MOH Dedicate Emergency Operations Center [Internet]. U.S. Embassy in Liberia. 2015 [cited 2022 Feb 20]. https://lr.usembassy.gov/embassy-moh-dedicate-emergency-operations-center/
  62. 62. Division of Global Health Protection. Faster, Smarter Outbreak Response in Liberia [Internet]. Centers for Disease Control & Prevention. 2017 [cited 2022 Feb 20]. https://www.cdc.gov/globalhealth/healthprotection/fieldupdates/summer-2017/liberia-outbreak-response.html
  63. 63. Brault MA, Kennedy SB, Haley CA, Clarke AT, Duworko MC, Habimana P, et al. Factors influencing rapid progress in child health in post-conflict Liberia: a mixed methods country case study on progress in child survival, 2000–2013. BMJ Open [Internet]. 2018 [cited 2022 Feb 20];8(10). https://www.ncbi.nlm.nih.gov/labs/pmc/articles/PMC6196853/ pmid:30327401
  64. 64. Clarke A, Blidi N, Yokie J, Momolu M, Agbo C, Tuopileyi R, et al. Strengthening immunization service delivery post Ebola virus disease (EVD) outbreak in Liberia 2015–2017. Pan Afr Med J [Internet]. 2019 [cited 2022 Feb 20];33(Suppl 2). Available from: https://www.ncbi.nlm.nih.gov/labs/pmc/articles/PMC6675927/ pmid:31402965
  65. 65. The DHS Program. STATcompiler [Internet]. [cited 2022 Feb 20]. https://www.statcompiler.com/en/
  66. 66. Wesseh CS, Najjemba R, Edwards JK, Owiti P, Tweya H, Bhat P. Did the Ebola outbreak disrupt immunisation services? A case study from Liberia. Public Health Action. 2017 Jun 21;7(Suppl 1):S82. pmid:28744444
  67. 67. Zolia Y, Musa E, Wesseh CS, Harris B, Gebrekidan MZ, Karamagi H, et al. Setting the Scene for Post-Ebola Health System Recovery and Resilience in Liberia: Lessons Learned and the Way Forward. Health Syst Policy Res [Internet]. 2017 Jan 17 [cited 2022 Feb 20];4(1). Available from: https://www.hsprj.com/abstract/setting-the-scene-for-postebola-health-system-recovery-and-resilience-in-liberia-lessons-learned-and-the-way-forward-18326.html
  68. 68. World Health Organization. Monitoring the Building Blocks of Health Systems: A Handbook of Indicators and Their Measurement Strategies [Internet]. Geneva, Switzerland: World Health Organization; 2010. https://www.who.int/healthinfo/systems/WHO_MBHSS_2010_full_web.pdf
  69. 69. Republic of Liberia. The Economic Stabilization and Recovery Plan [Internet]. 2015 [cited 2022 Feb 20]. https://reliefweb.int/sites/reliefweb.int/files/resources/liberia_-_economic_stabilization_and_recovery_plan_2015-2017.pdf
  70. 70. Ministry of Health. National EPI Strategic Plan (Draft) 2016–2020 [Internet]. Monrovia, Liberia: Republic of Liberia; 2016 [cited 2022 Feb 20]. http://www.africanchildforum.org/clr/policy%20per%20country/2018%20Update/Liberia/liberia_comprehensivemultiyearplan_2016-2020_2016_en.pdf
  71. 71. Republic of Liberia. Joint National Action Plan for Health Security (NAPHS) [Internet]. Monrovia, Liberia: Republic of Liberia; 2018 [cited 2022 Feb 20]. https://extranet.who.int/sph/sites/default/files/document-library/document/20062018%20Liberia%20NAPHS%20Final%20version.pdf
  72. 72. Ministry of Foreign Affairs. Public Health Law of Liberia as Revised, 2019 [Internet]. 33 2019. https://moh.gov.lr/wp-content/uploads/FINISHED-DRAFT-REVISED-PUBLIC-HEALTH-LAW-REPUBLIC-OF-LIBERIA-2019_Validation.pdf
  73. 73. Earle AJ, Sparkes SP. Financing Common Goods for Health in Liberia post-Ebola: Interview with Honorable Cllr. Tolbert Nyenswah. Health Syst Reform. 2019;5(4):387–90.
  74. 74. UNICEF. UNICEF Liberia Ebola Outbreak Weekly Situation Report #78 [Internet]. UNICEF; 2015 Mar. https://reliefweb.int/report/liberia/unicef-liberia-ebola-outbreak-weekly-situation-report-78-25-march-2015
  75. 75. Gavi, the Vaccine Alliance. Joint Appraisal Report 2017 [Internet]. Gavi, the Vaccine Alliance; 2017 Mar [cited 2022 Feb 20]. https://www.gavi.org/sites/default/files/document/joint-appraisal-liberia-2017pdf.pdf
  76. 76. Gavi, the Vaccine Alliance. Liberia Joint Appraisal Update Report 2018 [Internet]. 2018 [cited 2022 Feb 20]. https://www.gavi.org/sites/default/files/document/joint-appraisal-liberia-2018pdf.pdf
  77. 77. Wesseh CS, Nagbe T, Kruger J, Hamblion E, Clement P, Bawo L, et al. Integrated disease surveillance and response in Liberia: national expert group meeting, 15–19 September 2015/Surveillance integree des maladies et riposte au Liberia: reunion d’un groupe d’experts national, 15–19 Septembre 2015. Wkly Epidemiol Rec. 2016 Mar 4;91(9):112–21.
  78. 78. WHO Regional Office for Africa. Technical Guidelines for Integrated Disease Surveillance and Response in the African Region: Third Edition [Internet]. Geneva, Switzerland: World Health Organization; 2019 Mar [cited 2022 Feb 20]. https://www.afro.who.int/publications/technical-guidelines-integrated-disease-surveillance-and-response-african-region-third
  79. 79. Nagbe T, Williams GS, Rude JM, Flomo S, Yeabah T, Fallah M, et al. Lessons learned from detecting and responding to recurrent measles outbreak in Liberia post Ebola-Epidemic 2016–2017. Pan Afr Med J. 2019;33(Suppl 2):7. pmid:31402966
  80. 80. Nagbe T, Naiene JD, Rude JM, Mahmoud N, Kromah M, Sesay J, et al. The implementation of integrated disease surveillance and response in Liberia after Ebola virus disease outbreak 2015–2017. Pan Afr Med J [Internet]. 2019 [cited 2022 Feb 20];33(Suppl 2). Available from: https://www.ncbi.nlm.nih.gov/labs/pmc/articles/PMC6675929/ pmid:31404272
  81. 81. Ahmed K, Bukhari MAS, Altaf MD, Lugala PC, Popal GR, Abouzeid A, et al. Development and Implementation of Electronic Disease Early Warning Systems for Optimal Disease Surveillance and Response during Humanitarian Crisis and Ebola Outbreak in Yemen, Somalia, Liberia and Pakistan. Online J Public Health Inform [Internet]. 2019 [cited 2022 Feb 20];11(2). Available from: https://www.ncbi.nlm.nih.gov/labs/pmc/articles/PMC6788902/ pmid:31632605
  82. 82. McNamara LA. Ebola Surveillance—Guinea, Liberia, and Sierra Leone. MMWR Suppl [Internet]. 2016 [cited 2022 Feb 20];65. Available from: http://medbox.iiab.me/modules/en-cdc/www.cdc.gov/mmwr/volumes/65/su/su6503a6.htm pmid:27389614
  83. 83. Bedford J, Chitnis K, Webber N, Dixon P, Limwame K, Elessawi R, et al. Community Engagement in Liberia: Routine Immunization Post-Ebola. J Health Commun. 2017 Mar 1;22(sup1):81–90. pmid:28854140
  84. 84. Ministry of Health. Revised National Community Health Services Policy [Internet]. Monrovia, Liberia: Republic of Liberia; 2015 Dec [cited 2022 Feb 20]. https://www.exemplars.health/-/media/files/egh/resources/community-health-workers/liberia/revised-community-health-services-policy-20162021.pdf
  85. 85. How Liberia reached zero cases of Ebola virus disease. Releve Epidemiol Hebd. 2015 May 22;90(21):259–60. pmid:26016012
  86. 86. Government of Liberia Launches Historic National Health Worker Plan to Reach 1.2 Million [Internet]. Last Mile Health. 2016 [cited 2022 Feb 20]. https://lastmilehealth.org/2016/07/24/government-liberia-launches-historic-plan/
  87. 87. The Elders. Ellen Johnson Sirleaf [Internet]. [cited 2022 Feb 20]. https://theelders.org/sites/default/files/elderBio/Ellen%20Johnson%20Sirleaf%20-%20Mar%202021.pdf
  88. 88. Ministry of Health. Investment Plan for Building a Resilient Health System 2015–2021 [Internet]. Monrovia, Liberia: Republic of Liberia; 2015 May. Report No.: 12. https://www.resilientinstitutionsafrica.org/sites/default/files/2018-09/%5BLIBERIA%5D%20Investment%20Plan%20for%20Building%20a%20Resilient%20Health%20System%20%282015-2021%29.pdf
  89. 89. Gavi, the Vaccine Alliance. Joint Appraisal Update Report 2019 [Internet]. Gavi, the Vaccine Alliance; 2019 [cited 2022 Feb 20]. https://www.gavi.org/sites/default/files/document/2020/Liberia%20Joint%20Appraisal%202019.pdf
  90. 90. Nagbe T, Yealue K, Yeabah T, Rude JM, Fallah M, Skrip L, et al. Integrated disease surveillance and response implementation in Liberia, findings from a data quality audit, 2017. Pan Afr Med J [Internet]. 2019 [cited 2022 Feb 26];33(Suppl 2). Available from: https://www.ncbi.nlm.nih.gov/labs/pmc/articles/PMC6675580/ pmid:31402968
  91. 91. Streifel C. How Did Ebola Impact Maternal and Child Health in Liberia and Sierra Leone? [Internet]. Washington, D.C.: Center for Strategic & International Studies; 2015 Oct [cited 2022 Feb 20] p. 26. https://csis-website-prod.s3.amazonaws.com/s3fs-public/legacy_files/files/publication/151019_Streifel_EbolaLiberiaSierraLeone_Web.pdf
  92. 92. Whitener B, Illner P. Catastrophe Capitalism: An Interview with Peer Illner [Internet]. The New Inquiry. 2021 [cited 2022 Feb 20]. https://thenewinquiry.com/catastrophe-capitalism-an-interview-with-peer-illner/
  93. 93. World Health Organization. Common goods for health [Internet]. [cited 2022 Feb 20]. https://www.who.int/westernpacific/health-topics/common-goods-for-health
  94. 94. Noor AM. Country ownership in global health. PLoS Glob Public Health. 2022 Feb 11;2(2):e0000113. pmid:36962146
  95. 95. Cash-Gibson L. Integrating Health Services [Internet]. Geneva, Switzerland: World Health Organization; 2018. (Technical Series on Primary Care). https://www.who.int/docs/default-source/primary-health-care-conference/linkages.pdf
  96. 96. Einav S, Hick JL, Hanfling D, Erstad BL, Toner ES, Branson RD, et al. Surge capacity logistics: care of the critically ill and injured during pandemics and disasters: CHEST consensus statement. Chest. 2014 Oct;146(4 Suppl):e17S–43S. pmid:25144407
  97. 97. Mounier-Jack S, Griffiths UK, Closser S, Burchett H, Marchal B. Measuring the health systems impact of disease control programmes: a critical reflection on the WHO building blocks framework. BMC Public Health. 2014 Mar 25;14:278. pmid:24666579
  98. 98. Data Powered Positive Deviance Initiative. The Data Powered Positive Deviance Handbook [Internet]. UN Development Programme; 2021 [cited 2022 Feb 20]. https://acceleratorlabs.undp.org/content/dam/acceleratorlabs/publications/DPPD_Handbook_Nov_2021.pdf
  99. 99. Topp SM, Schaaf M, Sriram V, Scott K, Dalglish SL, Nelson EM, et al. Power analysis in health policy and systems research: a guide to research conceptualisation. BMJ Glob Health. 2021 Nov;6(11):e007268. pmid:34740915